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Abstract 

Are minds subject to laws of physics? Are the laws of physics computable? Are conscious thought 
processes computable? Currently there is little agreement as to what are the right answers to these 
questions. Penrose (^^, p. 644) goes one step further and asserts that: a radical new theory is indeed 
needed, and I am suggesting, moreover, that this theory, when it is found, will be of an essentially non- 
computational character. The aim of this paper is three fold: 1) to examine the incompatibility between 
the hypothesis of strong determinism and computability, 2) to give new examples of uncomputable 
physical laws, and 3) to discuss the relevance of Godel's Incompleteness Theorem in refuting the claim 
that an algorithmic theory — hke strong AI — can provide an adequate theory of mind. Finally, we question 
the adequacy of the theory of computation to discuss physical laws and thought processes. 



1 Introduction 



Penrose (see also [41 ) has discussed a new point of view concerning the nature of physics that might 
underUne conscious thought processes. He has argued that it might be the case that some physical laws are 
not computable, i.e. they cannot be properly simulated by computer; such laws can most probably arise 
on the "no-man's-land" between classical and quantum physics. Furthermore, conscious thinking is a non- 
algorithmic activity. He is opposing both strong AI (according to which the brain's action, and, consequently, 
conscious perceptions and inteUigence, are manifestations of computer computations, Minsky ^), and 
Searle's contrary viewpoint (although computation does not in itself evoke consciousness, a computer 
might nevertheless simulate the action of a brain mainly due to the fact that the human brain is a physical 
system behaving according to (computable) mathematical "laws" ) . 

The aim of this paper is to examine the incompatibihty between the hypothesis of strong determinism and 
computabiHty, to give new examples of uncomputable physical laws, and to discuss the relevance of Godel's 
Incompleteness Theorem in refuting the claim that an algorithmic theory — like strong AI — can provide an 
adequate theory of mind. Our starting point is the foUowing paragraph from Penrose | |40[ | p.560: 
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It seems to me that if one has strong determinism, but without many worlds, then the mathemati- 
cal scheme which governs the structure of the universe would probably have to be non-algorithmic. 
For otherwise one could in principle calculate what one was going to do next, and then one could 
'decide' to do something different, which would be an effective contradiction between 'free wiU' 
and the strong determinism of the theory. By introducing non-computabiUty into the theory one 
can evade this contradiction — though I have to confess that I feel somewhat uneasy about this 
type of resolution, and I anticipate something more subtle for the actual (non-algorithmic!) rules 
that govern the way that the world works! 

2 From Boscovich to Godel 

Perfect determinism was considered earher by Boscovich Leibniz and Laplace (see Barrow Q). The main 
argument is similar to the one used by Penrose: if aU our laws, say, of motion, were in the form of equations 
which determine the future uniquely and completely from the present, then a "superbeing" having a perfect 
knowledge of the starting state would be able to predict the entire future. The puzzhng consequence appears 
as soon as one tries to carry out this prediction! 

Godel was interested in this problem as well. According to notes taken by Rucker (|Q, p.l81) Godel's 
point of view is the foUowing: 

It should be possible to form a complete theory of human behaviour, i.e. to predict from the 
hereditary and environmental givens what a person wiU do. However, if a mischievous person 
learns of this theory, he can act in a way so as to negate it. Hence I conclude that such a theory 
exists, but that no mischievous person wiU lcarn it. In the same way, time-travel is possible, but 
no person wiU evcr manage to kiU his past self. 

And he continues: 

There is no contradiction between free wiU and knowing in advance precisely what one wiU do. If 
one knows oneseU completely then this is the situation. One does not dehberately do the opposite 
of what one wants. 



3 Strong Determinism 

According to Penrose (|Q, p. 558-559) strong determinism 

is not just a matter of the futurc bcing determined by the past; the entire history of the universe 
is fixed, according to some precise mathematical scheme, for all time. 

Thus strong detcrminism is a variant of Laplace's scenario,^ according to which the stage is set at the 
beginning and everything foUows "mechanisticaUy" without thc intcrvcntion of God, without the occurrence 
of "miracles" (cf. Frank ||). 

Strong determinism does not imply a computable Universe, as it says nothing about the computabiUty 
of initial conditions or of physical laws.0 

Let us discuss this in the context of the computer science. Any program p requiring somc particular 
input s can be rewritten into a new program p' requiring no (the empty Ust 0) input. This can for instance 
been reaUzed by coding the input s of p as constants of p' . Likewise, any part of p' can be externaUzed 
as a subprogram s, whose code can then be identified with an input for the new program p. In this sense, 
the terms effective computation and initial value are interchangeable and thc naming merely a matter of 
convention. Therefore, if strong determinism leaves unspecified the computabiUty of initial values serving 

^ "A thing cannot occur without a cause which produces it". 

■^Assuming the Church-Turing Thesis, this is equivalent to saying that the laws of nature correspond to recursivc functions. 
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as input for recursive natural laws, it may as well leave unspecified the recursion theoretic status of natural 
laws. 

AU this sounds rather abstract and mathematical, but the emergence of chaotic physical motion has 
confronted the physics community with the theoretical question of whether or not to accept the classical (i.e., 
non-constructivist) continuum. As envisioned by Shaw and Ford p^ , along with many others, "classical 
chaos" emerges by the effectively computable "visuaUzation" of the incompressible algorithmic information 
of the initial values. Thereby, the classical continuum serves as an "urn" containing (almost, i.e., with 
probabihty one) only (uncomputable) Martin-Lóf/Chaitin/Solovay random elements. With probabihty one, 
the physical system "chooses" one random element of the continuum "urn" as its initial value. In this sense, 
chaotic dynamics expresses almost a tautology: put Martin-Lof/Chaitin/Solovay randomness in, get chaotic 
motion out. The non-tautologic feature is the "choice" of one elemcnt of the classical (i.e., non-constructivist) 
continuum. In order to be able to choose from non-denumerable many uncomputable objects, the axiom of 
choice has to be assumed. But then, one is confronted with "paradoxical" constructions utilizing this axiom 
(cf. Wagon [ p6| , p9[). In particular, one could transform every given physical object into any other physical 
object (or class of objects) in three processing steps: 

• decompose the original object into a finite number of pieces; 

• apply isometric transformations such as rotations and translations to the pieces; and finally, 

• rearrange them into the final form. 

This might be the ultimate production beh: one can obtain an arbitrary number of identical copies from a 
single prototype! We mention this utopy here not because of immediate technological applicability but to 
point out the type of shock to which the physics community is going to be exposed if it pretends to keep 
the "skeleton in the closet of continuum physics" . Indeed, all the foUowing examples of strong determinism 
clashing with uncomputability and randomness originate in the assumption of the appropriateness of the 
classical continuum for physical modelhng. 

Quantum theory does not offer any real advancement over classical physics in this respect. It is a "half- 
way" theory, in between the continuum and the discrete. As Einstein put it [ pO| , 

There are good reasons to assume that nature cannot be represented by a continuous field. From 
quantum theory it could be inferred with certainty that a finite system with finite energy can be 
completely described by a finite number of (quantum) numbers. This seems not in accordance 
with continuum theory and has to stipulate trials to describe reality by purely algebraic means. 
Nobody has any idea of how one can find the basis of such a theory. 

Continuous hidden variable models of quantum mechanics such as Bohm's model operate with 
pseudo-classical particles. The real-valued initial position of a Bohmean particle, for instance, is Martin- 
Lof/Chaitin/Solovay random with probability one. The particles move through computable quantum po- 
tentials. As in chaos theory, the random occurrence of single particle detections originates again in the 
assumption of the classical continuum. From this point of view, the Bohmean model of quantum mechanics 
is not a "mechanistic" theory, ahhough its cvolution laws might be recursive. 

Everett's many-world interpretation of quantum mcchanics is not much of an advance either. It saves 
the strong determinism by abandoning the wavc function coUapse at the price of a Universe branching off into 
(sometimes uncountable) many Universes at any measurement or beam splitter equivalent. Currently, there 
is very httle knowledge conccrning the computational status of the wave function^or continuous observables. 
Implicitly, the underlying sets are the classical (i.e., non-constructive) continua. 



^See Pour-El and Richards nÚ, and the objections in Penrose [kc[, and Bridgcs 
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4 Is Description Possible? 



Can a systcm contain a dcscription of itsclf? Of coursc, no finitc systcni can contain itself as a proper part. 
What we mean by "description" hcre is an algorithmic representation of thc systcm. Such an algorithmic 
representation could bc interprctable as a "natural law" sincc it should aUow thc effective simulation of the 
system from within thc system. 

Von Ncumann was concerned with thc question of sclf-description in thc context of the self- 
reproduction of (univcrsal) automata. His CcUular Automaton modcl was inspired by organic hfe-forms, 
and the description "blueprint" for sclf-rcproduction was inspircd by thc DNA. Today, automaton self- 
reproduction is just one apphcation of Klecne's fixed-point thcorcm [^, 

Von Ncumann reahzed that there must be a difference betwcen an "active" and a "passivc" modc of self- 
dcscription. Thc "passive" description is givcn to the system by some God-hke external agent or oraclc. It is 
thcn possible for a finite system to contain such a "passivc" representation of itself within itself as a proper 
part. Based on this dcscription, thc system is capable of simulating itsclf.^ Such a sclf-description in gencral 
cannot be obtaincd "actively" by sclf-inspection. The reason for this is computational complcmcntarity 
P?! , ^ and thc rccursive unsolvabihty of the rulc infcrencc problem . 



5 Is Prediction Possible? 

Is there any incompatibihty bctwecn the strong determinism and computabihty, as Pcnrose suggests? Is it 
indeed impossible for a pcrson to "lcarn his own theory" (Godcl)? 

Let us assumc that we have both strong determinism and computable physical laws. For the remainder 
of this paper we fix a finite alphabct A and denote by A* thc set of all strings over A\ \x\ is thc length of the 
string X. K ( Chaitin) computer C is a partial recursivc function carrying strings (on A) into strings such that 
thc domain of C is prcfix-frec, i.c. no admissiblc program can be a prefix of anothcr admissible program. If 
C is a computer, then Tc denotcs its time complexity, i.e. Tc{x) is the running time of C on the entry x, 
if X is in thc domain of C; Tc{x) is undefincd in thc opposite case. Onc can prove Chaitin's Theorem (see, 
for instance, Chaitin ||l2|, |l^, Caludc [^, Svozil |^) stating the existcncc of a universal computer U such 
that for every computcr C there exists a constant sim{U, C) — which dcpends upon U, C — such that in case 
C{x) — y, there exists^ x' such that 

U{x') = y, (1) 

\x'\ <\x\+ sim{U,C). (2) 

Assume, now, for the sake of a contradiction, that an "algorithmic prediction" is possiblc. Thcn the 
universal computer can simulate thc prcdictor, so it can itself act as a predictor. What docs this mean? The 
computer U can simulate every other computer (|l|), in a shorter time. Formally, to equation (|l|) we add 

Tu{x') < Tc{x). (3) 

Now, let us examine the possibihty that [/ is a prcdictor. For every string x in the domain of U lct 

t{x) = min{Tc/(z) | z e A*, U{z) = U{x)}, (4) 

i.e. t{x) is the minimal running time ncccssary for U to producc í7(.t).^ 

Next define the temporal canonical program (input) associated with x to be the first string (in quasi- 
lexicographical ordcr) x"^ satisfying thc equation (^: 

X* = min{z e dom{U) \ U{z) = U{x),Tu{z) = t{x)}. 



^Certain prediction tasks cannot be speeded up, though; sec thc discussion below. 
^And can be eíTectively constructed. 
^Actually, t(x) is not computable. 
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So, 

U{x*) = U{x), and Tu{x*) = t{x). 

As the universal computer [/ is a predictor itself, and for itself, it foUows from (|^) that there exists a string 
x' such that U{x') — U{x*) — U{x), and Tij{x') < Tjj{x*) = t{x), which is false. Therefore, every universal 
predictor is "too slow" for certain tasks, in particular, predicting "highly time-efñcient" (or, alternatively, 
"highly time-consuming" ) actions of itself.|^ 

The reason for the above phenomcnon can bc iUustrated by showing the existence of " smah-sized" 
computers requiring "very large" running times. To this aim we use Chaitin's version of the Busy Beaver 
function E. Denote by H Chaitin complexity (or, algorithmic information content), that is the function 
defined on (aU) strings by the formula 

H{x) = mm{\y\ \ y G A*,U{y) = x}, 

i.e. H{x) is the length of thc smaUest program for the univcrsal computer U to calculate x. For every 
natural m let us denote by string{m) the mth string in quasi-lexicographical order, and let S(n) be the 
largest natural number whose algorithmic information content is less than or equal to n, i.e. 

E(n) = max{m | m e IN , H{string{m)) < n}. 

Chaitin (|l^, 80-82, 189) has shown that S grows larger than any recursive function, i.e. for every recursive 
function /, there exists a natural number N, which depends upon /, such that S(n) > f{n), for aU n > N: 
indeed, any program of length n either halts in time less than E(n -|- 0(1)), or else it never halts. 

As H{string{Yi{n))) < n, it foUows that U{yn) = string{Yi{n)) , for some string y„ of length less than n. 
This program i/„ takes, however, a huge amount of time to halt: there is a constant c such that for large 
enough n, U{yn) takes between Y,{n — c) and E(ri -|- c) units of timc to halt. To concludc, thc equation (^) 
is compatible with ^ (Chaitin's Thcorem), but incompatiblc with (^). 

Computation is a physical process, inevitably bound to physical degrecs of freedom; aU known physical 
laws, in turn, are ultimately expressible by algorithms for information processing (i.e., they are computable). 
The above discussion revealed some mathematical hmits; they can be completed with pure physical hmits, 
as discovered by Mundici Due to the fact that every computer is subject to the irreversibihty and 

uncertainty of time-energy, and maximaUty of the speed Ught, one can derive the foUowing result: The total 
time t and energy E spent for every computation consisting of n steps satisfy the inequality: 

n h 
t > n^ 



where h is Planck constant. For instance, it foUows that computations involving more than lO^'' steps are 
infeasible. 

This suggests that even inthe case the Universe is deterministic and unique, and its underlying laws are 
algorithmic, an algorithmic prcdiction is impossible. It justifies also Gódcl's claim according to which "no 
person wiU ever learn his theory" in spitc of the fact that such a theory might exist. 



6 Uncomputability and Randomness: Two Examples 

Various physical problcms lead to the question whethcr a function, in a ccrtain a class, has a real root. Results 
due to Richardson [Q, Caviness |jll|, Wang js^ (sec also Matijasevic [Q) show that for a large class of 
weU-defined functions such a problem is not algorithmicaUy solvable. Da Costa and Doria have proven 
some undecidabihty results in physics using this tool. A different approach, based on Specker's Theorem, was 
developed by Pour-El and Richardson |4^. In this chapter we shall build on the work of Richardson, Wang, 
and Chaitin to show that two problems in elementary physics are undecidable and display pure randomness. 

^For an early invcstigation of a forecast inspired by recursion theory see Poppcr . 

^Gandy jisj has put forward related arguments imposing hmitations to mathematical knowlcdge by the finiteness of 
physical objects. 
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6.1 Richardson-Wang and Chaitin Theorems 

An exponential Diophantine equation is of the form 

Ei{xi, . . .,Xrn) = E^ixi, . . .,Xm), 

where Ei^E^ are expressions constructed from variables and natural numbers, using addition, multiphca- 
tion, and exponentiation. The equations which do not make use of exponentiation are cahed Diophantine 
equations. Fermat's famous equation 

(p + 1)^+3 + + 1)^+3 = (r + 1)^+3, 

is an example of an exponential Diophantine equation. For every fixed s, the above equation is a Diophantine 
equation, for instance, the equation 

(p + lf + (g + l)3 = (r + l)3. 
By a family of (exponcntial) Diophantine equations we understand an (exponcntial) Diophantine equation 
Ei{ai, . . . , a„, xi, . . . ,Xm) = E2{ai, . . . , a„, xi, . . . ,Xm), (5) 



m ; 



in which the set of aU variables ai, . . . , a„, xi, . . . , Xm is divided into two classes, unknowns, xi, . . . ,x. 
and parameters, ai, . . . ,0^. A set S C ÍV" is caUed (exponential) Diophantine if there exists a family of 
(exponential) Diophantine equations (|^) such that 

S = {(ai,...,a„) e lN"'\Ei{ai,...,an,xi,...,Xm) = E^^ai, . . . , an, xi, . . . , Xm), 

for some naturals xi, . . . , Xm}. 

Due to work of Davis, Matijasevic, Putnam, Robinson (see Matijasevic [Q) the foUowing classcs of sets 
were shown to coincide: 1) the class of recursively enumerable sets, 2) the class of exponential Diophantine 
sets, 3) the class of Diophantine sets. 

By virtue of the existence of recursively enumerable sets which are not recursive (see, for instance, Calude 
0) we deduce that the problem of testing whether an arbitrary (exponential) Diophantine equation has a 
solution (in natural numbers) is recursively undecidable.^ A universal (exponential) Diophantine set, i.e. a 
set which "codes" aU (exponential) Diophantine sets is recursively enumerable, but not recursive. 

In contrast with the case of (exponential) Diophantine equations — deahng with solutions in natural 
numbers — the problem of deciding the solvabiUty of polynomial equations with integer coefficients in real 
unknowns is decidable. In the unary case this can be done by the wcU-known Sturm method; in the general 
case one have to use Tarski's method To get undecidabiUty we have to ahow the use of some other 

functions; an easy way to achieve this is to consider the addition, mufiiphcation, composition and the sine 
function, aU rationals and tt. 



For our aim it is convenient to reformulate Richardson |44 and Wang ||57| results as fohows. We define, 
for every natural n > 1, A„ to be the minimal (with respect to set-theoretical inclusion) family of expressions 
which contains aU rationalsand tt, the variables xi, . . . ,Xn, the functions sin{x) and e^, and which is closed 
under the operations of addition, muhiphcation, and composition. 

The foUowing predicates are recursively undecidable: 

• For every G{xi) e Ai, "there exists a real number r such that G{r) = 0". 

• For every G{xi) G Ai, the predicate "the integral J^^[{x'^ + l)G^{x)]^^dx is convergent". 



'This solved in the negative Hilbert's Tenth Problem. 
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FoUowing Chaitin ||T^, |l^ we do not ask whether an arbitrary Diophantine equation has a solution, 
but rather whether it has an infinity of solutions. Of course, the new qucstion is stiU undecidable. In 
the former case the answers to such questions are not independentf^ but in the later one the answers can 
be independent in case the equation is constructed properly. ActuaUy Chaitin has effectively constructed 
such an exponential Diophantine equation (see his last Lisp construction in |T^ ) with the property that the 
number of solutions jumps from finite to infinite at random as a certain íixed parameter is varied. Actually, 
saying that the "number of solutions jumps from finite to infinite at random" is not a figure of speech, it 
is just a remarkable technical statement: if the parameter n takes the values 1,2, . . ., and a;„ = in case 
the corresponding equation has finitely many solutions, and ujn ^ í, in the opposite case, then the sequence 
ÍÜ1LÜ2 ■ ■ ■ uji ■ ■ ■ is random in Martin-Lof/Chaitin/Solovay sense; see Calude The real number number 

íi = O.UJ1LÜ2 ■ ■ ■ Ui ■ ■ ■ 

represents the halting probabihty of a universal computer. In case we assume the hypothesis of strong 
determinism, fl has also a "physical" significance: it represents a constant of the Universej^ The number 
n is not invariant under changes of the underlying universal computer. However, all "constants" f2 share a 
number of fascinating properties (see, for instance, Calude ||]); these changes might be similar to changes of 
other "constants of Nature" , as Newton's gravitational constant, the charge of an electron or the fine-structure 
constant, under certain circumstances (changing the number of dimensions of the space, for instance). 

6.2 One-dimensional Heat Equation 

Improper integrals, for example, Fourier and Laplace transforms, play a particularly important role in 
modelling physical phenomena (see, Courant, Hilbert p9[ |, §tefánescu [p2[). Two examples involving the 
Laplace transform iUustrate uncomputabihty and randomness. 

Let us first consider the heat conduction on an infinitc slab. It is dcscribcd by thc onc-dimcnsional hcat 
equation: 

'dt ~ dx^ ^ ^ ' ' 

u{x,0) = f{x), (6) 
u{x, t) is bounded. 

If — and -— ^ are supposed to be continuous and bounded, then thc solution of (p|) may be obtained 

ot ox'' ^ 

via the Laplace transform (see, Friedrichs |23]):Fj 



1 /"^ ^i5-y)l 

u{x,t) = / e « f{y)dy. (7) 



2V7rí 



6.3 A Problem of Electrostatics 

Let us consider the plane electrostatic problemp^ on iR x ]R+ which satisfies the boundary potential condition 

^{x,0)=f{x). 



^"^The reason is simple: we can determine which equations havc a sohition if we know how many of them are solvable. 
^'^There is something attractive about permanence. 

^■^Notice that the solution of the problem may be also obtained by meansof thc Fouricr transform. It is possiblc that for 
some functions / the Laplace (or Fourier) transform does not exists, and still (W) verifies (p|). 

^^A problem of electrostatics is plane if there is a distinguished direction such that all data are constant in this direction and 
the field to be determined is also constant in this direction; Fricdrichs psl. 
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^Í^^V)-Z¡ u il' 2 dt- (9) 



If $ is an electrostatic potential, then the electric field E is given by 

E = -grad 

If D is a plane domain (i.e. an infinitely long cyhnder with cross section D) bounded by a surface C 
composed of several conductors|^ at different potentials, then $ is is a solution of the systempl 

^ + ^ = o,(.,,)eD, 

<i>(x,0) = /(x). 

The problem (^) can be solved via the formahsm of differential forms.|^ The solution of (^) is given by 

y_ r fjt) 

ttI^ {t-x)^ + y^ 

First we look at the solution of the one-dimensional heat equation (^. If f{y) = {y^ + 1)^^, then, for 
every fixed {xo,to), the solution 

1 e 

u{xo,to) = — dy 

2V7I-Í0 J-00 y + 1 

is finite. 

Consider now the function f{y) = . Let íq > 1 and xq G Mhe fixed. Thcn 

e ''*o f{y) > e^ « — 
For fixed xo, hmy^oo + — ^ = 00, so the integral 

e «0 /(y)dy 



00 



is divergent. 

If f{y) — {y'^ + í}~^H~'^{y) then, for every fixed {xq.Íq), we get the solution 



"(^- ^''^ - y_ (TTT)^'^ - y_ (y2 + i)i^2(.)'^- 

In case H was in Ai, then K is in Ai as weh. So, the problem to test, for fixed {xq, to), whether the solution 
u{xo,to) is finite or not for an arbitrary function H e Ai, is recursively undecidable. 

Using Chaitin's construction we can exhibit a sequence of functions ií¿ € Ai such that the induced 
sequence C1C2 • • • Q • • •, c¿ = 0, if the corresponding solution is finite, c¿ = 1, in the opposite case, is random. 
So, in the space of all solutions of (|^) there are areas in which convergence and divergence alternate in a 
pure random way. 

Similar results can be obtained for the solution of the electrostatic plane problem. For fixed xo,yo, Vo 7^ 0, 
the solution (^ can be represented as 

ff./ \ ^ í°° fiVou + xo) , , 



^Va J-c 

If f{x) = G{x)^'^, where G is a function in Ai, then the the problem of testing whether ^{xo, yo) is finite or 
not is recursively undecidable. Again, we can effectively construct a sequence of solutions displaying pure 
randomness, i.e. for which the sequence of answers to the convergence problem is random. 

'^^The conductors are materials which do not exert any force on charged particles in their interior, but they do so at the 
boundary. In a state of equiUbrium the charges contained in a conductor are distributed over the boundary. 

^^The same system can be derived from conduction of electricity on a conducting sheet covering the domahi D. 
^^The local existence of a potential <I> is described by the equality E = — d"í>; see Bamberg and Sternberg 
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7 Incompleteness 



In a remarkable paper entitled Intelligent Machine^J\ (@l' 107-127) Turing investigates the possibility 
as to whether machines, i.e. computers, might show intcUigent behaviour. He considers the argument that 
machines are inherently incapable of exhibiting human-hke intelhgent behaviour, because human mathemati- 
cians are capable of determining the truth or falsity of mathematical statements in a way that machines, 
as embodiments of formal systcms that are subject to the hmitations of Godel's Incompleteness Theorem, 
cannot. Turing notes that Godel's Incompleteness Theorem 

rests essentially on the condition that thc machinc must not makc mistakes. But this is not a 
requirement for intelhgence. 

He is suggesting that machines might perhaps equal human mathematicians if they were equipped with 
a human-like capacity to make mistakes. 

The analysis of predictabihty outhned in this paper is subject to Turing's objection regarding mistakes. 
Accordingly, we address the foUowing question: Is Turing's argument irrefutable? 

At a first sight, requiring the absence of mistakes might seem to be overly restrictive. But how can a 
mistake-making niachine be constructed? Where should we place the border between "admissible" and "non- 
admissible" mistakes in order to preserve the "inteUigibihty" of our Universe. How can a mistake-making 
machine discover the regularities, common factors, recurrences, and imphcations, which tcU us what things 
are and how are they going to be in the future? According to Barrow p. 269): 

the inteUigibihty of the world amounts to the fact that we find it to be algorithmicaUy compress- 
ible. We can replace sequences of facts and observational data by abbreviated statements which 
contain the same information content. These abbreviations we often call "laws of Nature". 

However, we know that a total compression of thc Universe is not actuaUy possible as the existence of 
chaotic processes points out (Chaitin [|l2[ |l^, Rucker |Q, Svozil |5^, Calude [||, Calude and Salomaa 
Ip^). How can we describe seemingly random processes in nature and reconcile them with supposed order? 
How niuch can a given piece of information be compressed? Calude and Salomaa [|l^ have suggested that 
the Universe is actuaUy globaUy random, and, consequently, locaUy ordered. The Universe, hke any network- 
hke structure can be seen both at local and global levels. Local properties require only a very nearsighted 
observer — and for this level, science is indeed very useful and successful — but global properties are much 
more difficuU to "see" , they need a sweeping vision. For instance, the overaU shape of a spiderweb is a global 
property, while the average number of hnes meeting a vertex is a local characteristic. 

The relevance of Godel's Incompleteness Theorem p2[ argument has been questioned by different authors, 
especially by Boolos, Chalmers, Davis and Perhs (see ]41|]; it contains also Penrose's reply). In our opinion, 
Turing's critique — mentioned above — is the most substantial. It questions the status of Godel's famous 
unprovable statement: is this unprovable statement — seen to be "true" by Penrose — esoteric, accidental? 
Does the incompleteness phenomenon have any relevance for a scientist's daily life? This is a rather delicate 
question. If we adopt a topological point of view (see Calude, Jürgensen, Zimand [^), then incompleteness 
is a rather common, pervasive phenomenon: the set of true, but unprovable statements is topologicaUy "very 
large" , i.e. with respect to any reasonable topology the set of true and unprovable statements of a sufficiently 
rich, sound, and recursively axiomatizable theory is dense and in many cases even co-rare. It is important 
to notice that the above resuU holds true not only globally, but even for "fixed" problems. For instance, 
the halting problem: there exists a large set of true, but unprovable, statements stating that some Turing 
machine wiU never halt on a fixed entry. 

The natural way to model "admissible mistakes" is to work with probabihstic Turing machinesf^ instead 
of (ordinary) Turing machines. A probabihstic Turing machine has some distinguished states acting as 

'^^This paper has attracted less interest than Computing Machinery and Intelligence {[Q, 133-160); for instance, Penrose 
does not quotc it at all. 

^^This type of machine is sometimes called a Monte Carlo algorithm. 
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"coin-tossing states" for which the finite control specifies p > 2 possible next states. The computation is 
deterministic except that in the distinguished states the machine uses the output of a random experiment to 
decide among the p possible next states. So, a probabihstic Turing machine can make mistakes; the output is 
not "truly correct" , but "correct within a probabihty" . Classical results due to De Leuuw, Moore, Shannon, 
and Shapiro and GiU |^ show that the class of functions computed by probabiUstic algorithms coincides 
with the class of recursive functions. The difference is only in complexity: if we do not insist on a guarantee, 
then sometimes it is possible to compute faster. AU resuUs pertaining incompleteness, previously discussed, 
remain vaUd, so it appears that Turing's objection cannot be supported anymore: this probabiUstic space 
inherits the non-computabiUty of the deterministic one. 



8 Computability 

Is the theory of computabiUty (recursion tUeory)|^ an appropriate framework to discuss physical laws and 
thought processes? It is not unreasonable to suspect that the notion of computation wiU play a major role 
in future researcU in the natural sciences; however, the global picture is more complex than it appears on a 
first analysis. 

Recursion theory is useful for proving the existence of uncomputable physical laws. If we are interested 
in "useful" physical laws, i.e. laws which can be effectively used for practical purposes, then the theory of 
computation might not be the appropriate tool. Indeed, it may happen that some function is computable, 
but it is very difñcuU to compute,^ or even worse, that the computable function is impossible to compute 
at aU. For instance, consider tUe Continuum Hypothesiíj^ and the foUowing function 



/(") 



1, if tUe Continuum Hypothesis is true, 
0, if the Continuum Hypothesis is false. 



suggested in Bridges . According to classical logic, / is computable because there exists an algorithm that 
computes it, i.e. the algorithm that returns either one or zero, for aU non-negative integers. Deep work due 
to Godel js^ and Cohen||l^ shows that neither the Continuum Hypothesis nor its negation can be proven 
within Zcrmelo-Fraenkel set theory augmcnted with the Axiom of Choice, the standard framework of classical 
mathematics, so we wiU never know which of the two algorithms — "print one", or "print zero" — is the right 
one. We conclude that the standard theory of computable functions does not match computational practice! 
The paradoxical nature of this example comes from the underlying logic of computabiUty. To Uandle tUis 
problem we have to distinguish between existence in principle and existence in practice. A possible approach 
is to consider provable computable functions introduced by Fischer [p^ . A computable function is caUed 
provable with respect to some formal system S which contains second order arithmetic if there exists an 
algorithm which computes it and which can be proven to be total in S. These functions are interesting 
because they are functions we usuaUy work with in practice, e.g. in numerical analysis. What do we lose 
sacrificing aU computable functions in favour of provable computable ones? Gordon pl|] has proven that 
this class of functions is a complexity class, i.e. it can be computed with Umited resources, say in time. 
Now, if we apply some resuUs in Cahide we arrive at the conclusion that there is an essential difference 
between computable functions and provable computable functions: in a constructive sense, the former class 
is of second Baire category (i.e. large) while the later one is meagre (i.e. small). InformaUy this means that 
most computable functions are not provable computable; the difference between functions "computable in 
principle" and provable computable functions is significant.p^ 

truly remarkable achievement of modern mathematics is the discovery of recursive (or, computable) functions, i.e. 
functions which can be computed by algorithms. Within the realm of this theory it is possible to prove the existence of 
functions that are not computable by any algorithm whatsoever. The theory of computabihty has not yet become part of 
mainstream physics, but it can serve perfectly well as a guiding principle to hitherto informal notions such as "determinism" . 

^"Actuallv. for every computational measure, for instance, time or space, there exist arbitrarily difñcult to compute functions; 
see Calude |pf. 

^^There is no cardinal number strictly in bctween aleph-nuU, the cardinal of the the set of natural numbcrs, and alcph-one, 
the cardinal of the set of reals. 

^■^ln this context it is interesting to note a result — obtained in 1964 — which can be considered as "Chaitin (very first) 
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9 Conclusions 



The paradox mentioned by Penrose is not real, because "real predictors" do not exist.^ This is because 
every (universal) predictor is "too slow" for certain tasks, in particular for prcdicting actions of itself. Two 
more examples of uncomputabiHty of physical laws are discussed. Turing's objection concerning Godel's 
Incompleteness Theorem is confronted with the fact that, from a topological point of vicw, the incompleteness 
phenomenon is common and pervasive; this resuh is stiU true for probabihstic Turing machines, i.e. for 
machines aUowed to make "reasonable" mistakes. Although we have refuted Penrose's argument that strong 
determinism and computabihty are logicaUy incompatible, we have found independent reasons to support his 
conchision concerning the non-computabihty of physical laws. FinaUy we are lead to the foUowing question: 
is the theory of computation an appropriate framework to discuss physical laws and thought processes? We 
argue that for proving non-computabiHty resuUs the answer is affirmative; for more practical purposes, in 
which we are interested not only in discovering physical laws, but in using them to make predictions, the 
answer might be negative. Other aspects of the problem, e.g., the role of the observer and "approximation" 
in making predictions, wiU be treated in another paper. 
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